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This paper looks at the issues and problems involved 
in the evaluation of competency-based teacher education programs, A 
major fallacy of CBTF programs is that they are based on the 
following implicit assumptions which have little theoretical or 
empirical support: (a) that there is much more agreement than the 
literature indicates on the goals and purposes of education, the 
competencies derived from these goals, and the timing and sequence of 
pupil couipetencies; and (b) that is a specific set of goals and 
objectives could be agreed upon, a valid set of corresponding teacher 
competencies could then be derived which promote these objectives. 
Evaluation of CBTE programs presents a second series of problems 
which include level of competence measured, the relationship of the 
measure to the particular competency, quality of the evidence, and 
isolation of factors which contribute to the achievement of the 
competencies. Despite these limitations, the University of California 
at Berkeley CBTE Programs will attempt to evaluate their programs in 
terms of the achievement of objectives and competencies, ongoing 
processes by which objectives are achieved, unplanned outcomes, and 
student background. This information will be analyzed and summarized 
in periodic reports. (PB) 
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The purposes of this paper ar» (I) to examine some of the conceptual and 
practical issues involved in the evaluation of teacher education programs and 
(2) to present a framework and rationale for the procedures to be used in 
designing the evaluation of the Teacher Education Programs at University o£ 
California at Berkeley. 

ISSUES & PROBLEMS 

There are many issues and problems involved in the evaluation of Teacher 
Education. Only two types of issues will be considered in this paper: 

(1) issues luherant in competency based teacher education programs; and 

(2) problems relating to the measurement and assessment of competency 
based programs. 



A major fallacy of Competency Based Teacher Education Progr»o« (CBTE) is 
that these programs are based on two types of Implicit asdumptlona which have 
little theoretical or empirical support. 
Assumptions regarding Theoretical Support 

CBTE programs assume, first of all, that there is much more agreement 
than the literature indicates on (1) the goals and purposes of educatttn, 
(2) the competencies derived from these goals, and (3) the timing and 
sequence of pupil competencies. 

Goals and purposes of education. In their excellent analysis of the 
aims of education, Kohlberg and Mayer (1972) contrast three different 



Problems of Competency Ba^ed Teacher Education Pyograns 



BEST COPY AVAILABLE 

-2- 

educational ideologies: (1) a "progressive*' nodel whose goal Is to promote 
the attainnenc of higher levels of cognitive, ©oral, and ego development* 

(2) a "rooaotlc" model, which atressea Dental health and happiness; and 

(3) a "cultural tranaolsslon" oodel whose purpose is to ts'Qnsalt the know 
ledge, skills, and rules of the culture. Each of these ideologies Is based on 
a different set of values and on a different conception of what society needs 
and what is good for children. As a consequence, there is little comaonallty 
anong the primary goals and objectives of the three models. 

Coppetenciea derived from goals . Advocates of each of these model* 
would establish different types of educational programs based on the specific 
goals and objectives of the particular model of education. A different set of 
pupil competencies could then be derived from the particular model. Similarly, 
a specific set of teacher competencies could be generated appropriate to the 
particular model. These teacher competencises would be expected to promote 
the achievement of the particular pupil competencies. For example, where the 
transmission of such cultural skills as reading and computation is the pur- 
pose of education, the teacher should be competent primarily in teaching 
specific language, reading, and mathematical skilla. In contrast, teachers 
whose aim is to promote the highest possible levels of cognitive, moral, and 
ego development --as described in the "progressive model""WOuld need to 
acquire a set of teaching competencies which would Include sensitivity in 
detecting stages of development and strategies to promote higher levels of 
development for each Individual. Measuring the achievement of these pupil 
competencies would provide evidence as to whether the objectives of the model 
had been met. 

Thus, an application of Kohlberg and Mayer's review to the field of 
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competency based teacher education illustranes that there are at least three 
viewpoints on the aias of education^ yielding three conceptions of the most 
important conp^tencies for teachers to acquire in order ^o promote optimal 
learning fcr their pupils* 

Howover, it night also be possible to select a number of goals and 
competencies from each of these models in an eclectic fashion. Such a 
selection would result in a fourth educational model and a fourth set of 
competencies. It is conceivable^ furthermore, that additional models which 
do not necessarily overlap with the first three models could be postulated 
and that competencies could then be derived from the goals of these new 
models. Nevertheless, any new model requires an explicitly stated rationale , 
based either on theory or on research. 

Tiv.it"g and spounnc e of c ompetencies. In addition to the different con* 
ceptici.j of p -pil cc^-patencies and the corresponding teacher competencies 
required as evidence of achievement of the objectives of each model, a further 
point of disagreement amcng educators concerns the most appropriate timing 
and sequcrrce for the achievement of particular competencies. Some educators 
have questioned the sequence of learning particular skills within g'^neral 
subject ratter areas, sv.ch as math. Others, such as Rohwer (1973) have 
questioned the efficiency of learning basic reading skills in the primary 
grades. Pxh^f^r proposes instead that the rxhiever*ent of competence in 
reading and math skills be postponed until the intermediate (junior high) 
years ♦ If this proposal were enacted, it would mean that teachers of pre* 
teen and adolescent children would need to be competent in teaching basic 
reading and math skills and that teachers of young children should be 
competent in guiding exploration and interpersonal relations rather than 
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pritaarily In instructing basic nath and reading skills as is the ccrrent 
practice. 

These differing opinions regarding the timing and scquencQ of skill 
learning and their inplications for teacher training have not been considered 
by nany competency baseJ tuachcr eiucation prot:ram9. 
Aasuoptiona regarding Eppirical Support 

Despite the fact that there secns to be divergent viewpoints concerning 
the purposes of education and the conpctcncies necessary for achieving the 
varying purposes of education, conpetency based teacher education prograna 
have been established. In sone cases, the coopetencics required nay indeed 
be derived fron a particular education ideology. In other cases, the philo- 
sophical and conceptual basis for specifying a particular set of teacher 
ccopetenciea does not appear to have been clearly articulated. 

In cither of these cases, the cstablishnent of conpetency based teacher 
education prograns proceeds under a second unexanined assuaption. This 
second assunption—inplicit in CBTE Prograns and Inplicit in the preceding 
di8cussion--is that if a specific set of goals and objectives could indo#»d 
be agreed upon, a valid set of corresponding teacher conpetencios could then 
be derived which promote those specified objectives. Unfortunately, however, 
reviews of the aviilablo research reveal few teaching strategics which have 
been conslstentiy identified with specific pupii outcomes generalizable 
across pupil populations (Combs. 1963; Rosenshine and Purst, 1973). The 
effectiveness of specific teaching strategies seems to vary according to a 
number of variables. For example, some researchers (e.g. Brophy and 
Evertson, 1974> have found that the effectiveness of teaching strategies 
depends on the socioeconomic and cultural group of the pupils. Certain 
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strategiaa were found to ha novo ufficiont with lower class pupils, while 
a different set was shown to be effective for middle class pupils. The porj5on- 
ality of the particular pupils secDs nlso to contribute to the effectiveness 
of particular teaching strntegios (e.g. Solooon, 1974). And so on. In other 
words, even if there wer^i ngreenent ns to what the aini of education should be, 
there is little rosenrch evidence which clcnrly and consistently links the 
achievenent of pupil conpetencies to specific teaching strategics (teacher 
coopetencies) . A stronger case could be nnde to support the establishnent 
of CBTE Programs if a firmer foundation of empirical research existed. 

Problems of Measuroncnt and Assessoient 
Regardless of the issues of the importance of particular teaching 
competencies, the evaluation of any CBTE Program presents a second series of 
problems. This series of problems includes; {I) the level of competence 
measured, (2) the relationship of the measure to the particular competency, 
(3) the quality of the evidence, and (4) isolation of factors--both within a 
program and beyond the program- -which contribute to the achievement of the 
competencies, (Traditional measurement problems, such as reliability and 
validity, will not bo explored here.) 
Level of Competence Measured 

The first of these problems concerns the levels of educational objectives 
(see Bloom, 1956) and the criterion used for the selection of the means of 
measurement. If one criterion for the selection of measures of competencies 
is the technical sophistication of the measurement, means of measuring com:^e* 
tencies may be limited to the knowledge level measured by traditional paper and pencil 
tests. However, it is likely that the higher cognitive levels of application 
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of knowledge and tho evnluation of the application arc oore nppropriato for 
purposes of achioving conpetont teaching than knowledge alone. Techniques 
for the neasurenent of these hlghar levels of educational objoctivo9--c.g 
classroom observation net hods * • loss ro fined but novorthclGS$ oAy b6 inorct 
appropriate for the purpose of the evaluation of nctu^il teaching perforDance. 
Relationship between Competency ^md Evidence 

A second neasureoent problem also related to that of the levol of educa- 
tional objectives is the relationship between the particular coopotency and 
the particular behavior stipulated as evidence of that competency. The 
probleo is one of whether or not the behavior required as evidence of a 
competency is indeed directly related to the competency for which it is 
supposed to be evidence. For example^ in a competency based progran» kruow- 
ledge of black dialect as nenaured by a multiple choice test may be stipulated 
as the required evidence of knowledge of cross-cultural variations in the 
teaching situation. A high score on this test nay yield evidence of awareness 
of black language at the knowledge level. However » this evidence--evcn at 
the knowledge level--may be an inadequate indication of the individual's 
awareness of black culture in the broader sense as it applies to the teaching 
situation. At this time, there seems to be n general paucity of established 
relationships between competencies and specified behavioral evidence. 
Standards of Quality 

The third measurement problem concerns the distinction between a mini- 
mum or minimally adequate standard of performance and the quality of compe* 
tence deemed acceptable. For example, as evidence of the student teacher's 
ability to diagnose skill levels, prescribe suitable lessons, and enhance a 
pupil's self -concept, a "child study'' report may be required. One student 
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teacher may have diagnoaad and prescribed adequately and concluded that the 
pupil's self-concept was enhanced by this skill learning. Another student 
teacher may do much more than the first by creating materials for the pupil 
which integrate the pupil's own interests and ethnic background with the 
particular sk.nis needed by this pupil for growth in skills and self-concept. 
The first student's report may meet a minimally adequate standard of perfor- 
mance; yet the quality of the nd student's report is clearly superior. 
Because the use of competencies usually does not discriminate qualitative 
differences in performance, it is important to establish minimum standards of 
performance at a sufficiently high level of quality. This issue reflects a 
concern with the training of teachers who are highly qualified as opposed to 
teachers who are minimally competent. 
Factors contributing to the Achievement cf Competence 

The fourth problem of measurement and assessment centers on the identifi- 
cation and isolation of factors which contribute to the effectiveness of the 
program. These factors include program components such as course work and 
student teaching as well as non-program components, such as student teacher's 
personality, prior knowledge, and those competencies acquired through such 
extra-program sources as colleagues and in-service courses. On one hand, it 
may be that the knowledge or skills acquired from any one source--lnternal or 
external to the program--may contribute to the achievement of competencies in 
such small degrees that the accretion of knowledge from any one source is 
inoeasurable. On the other hand, it may be that it is largely non-program 
factors, such as the personality, attitude, and prior experience of the 
student teacher, that determine whether or not competencies are achieved. The 
process of selecting student teacher candidates may be the crucial factor in 
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Whether or not the procr.in ia effective. It is rosaible that non-progratn 
factors --either (1) those with which the student enters, (2) thoae which are 
acquired concurrently with the teacher triininp, progr^ra, or (3) those learned 
subsequent 50 the teacher training year- -are the major deteminants of effec- 
tive teaching. Or any of these non-progran factors may interact with the 
components of a particular progran to produce effective teaching. The process 
of unraveling the tangled wcbb of contributing and interacting factors seeos 
overvrt^eloing. 

The possible contribution of non-prograo factor8--elther alone or in 
interaction--becocies even cioro cogent in evaluating the effectiveness of the 
progran graduates in follow-up studies, since the number of non-program factorq 
which may possibly affect a teacher's effectiveness increases. The adminis- 
tration, school morale, type of pupil population, school program limitations 
availability of supplies, class size, and so on, are auied to the already 
complicated list. 

RATIONALE FOR PROCEDURES OF PROGRAM EVALUATION 
Despite the limitations and reservations concerning competency based 
teacher education programs and the questions concerning the measurement of 
these competencies, California's Ryan Commission Guidelines require competency 
based teacher education programs as well as both a formative and a suranative 
evaluation of all approved teacher education p^'ograms. 

Focus of Evaluation 
The University of California at Berkeley CBTE Teacher Education Programs 
as approved by the CTPL are described in the Professional Preparation of 
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Teachers (Rynn Document). The issuw of the value or wortl of stated 
objeciives^-noted in the first soction'**is considered by some to bo a lart 
of the purpose nnd function of ovnluntion (Worthcn & SAndors, 1973) Novcr- 
theleast the evalurition of the University of Californini Tencher Education 
programs wil^ not focus at *ihis point on *.ho issue of v^hethor or nut objec- 
tives stated in the Ryan Document nre "good" fcr ale.^iontary or secondary 
students nov* on the problem of whether the ccmpctcncies required by the pro* 
grams are facilitativo of particulnr gonls. Instead, the primary thrust of 
the Evaluation will be on the achievement of the objectives and competoncias 
atated in the Ryan Document (aaJ the general and specific conditions stipu- 
lated by the CTPL) . 

To this end, information will be sought, where possible, concerning 
(1) the achievement of the objectives and competencies, (2) ongoing process'^r 
by which th^ objectives are achieved, (3) unplanned outcomes, and (4) the 
background of the students* 
Inf onaa t ion roRardin ^ Ob^ ect ives and^C omj2£ 

The first type of information to be sought pertiins to the achievement 
of the objectives and coinpetencies as perc. ivod by those involved in the 
program. Included will bo Information regarding whether or not a precisely 
specified S'^t of competencies required fcr pvogrn/i completion is clearly 
stated. For example, is there a cloar undwirntanding of the ir.inin^um number 
and level of competencies which naed to be achieved? 

Information concernirp, the appropriateness of the modes and levels used 
to assess coDpetence--noted in the section on measurement problcms--will 
also be gathered. For cxamfle, were the behaviors required as evidence of 
competence seen by those involve^ as valid evidence of these com; ctencics? 
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Var, nho lividcnco i\t thx knowlcJj»c or the nppUc.ition level? Was the standt^rd 
oi purforcinnce of in aJcqunte quility? 
Info roatlqr ^ r .qgr JlnR CnnoitiR P rocos f^os 

A joconl typo of informtlon to be collected concerns the ongoing 
functloni.ifj rf tho l*rap,r . Infonnatlon regarding the procedures, processes, 
and events as they occv^r will serve three purposes. First, this descriptive 
Irform^lon vlll ccntrlL ;tc cry an nndorstandlng of tho functioning of the 
progran. i:;:o-;!Gdge cf values and pattern?* of Interactions \;lthln the program 
will enable the Evaluators to nakn an analysis of the types of processes that 
facilitate or hinder the ongoing fu^nctlcnlng of the program. Hopefully, this 

l^rsrn^Jinp by individuals outside the program yet friendly to It will 
pr:rt:lt: '^c^dback and suggestions which will lead to program Inprovcment 
T-orro*- 197?). 

*nfo*Datlcn concerning ongolrg processes will overcome what 
rir *c C< Jc: ^1973) have called the *'rlsk of appraising a non-event". 
'^>dt Is, ir^^ormatlcn concerning what actually dlJ happen ^^ylll avoid attrl- 
bvtlt;g r:v':al.: o'tcrr.^::; ♦'o events that did not occur as planned. Knowing 
vbct actually happ^-^uod i..ay provide sonc Indication of the contribution of 
each of t>c p-cjrn-n co?oonerts to the rff^ctlvrness of the progra::***. 

Thirdly, iafo-natlon regarding th*^ ongoing functioning of the program 
;.;ay provlrle ror.:i :ndlcation of the con* iTlbutlon of each of the components of 
the progrr.r.^ tc tho overall ef f octlveiecs of tho programs. 
Inf ers. It i o; * ^ r;"^ Z^^^^A^Pf.^ *^Jl]-ilV*i^.,L.^"*^ ^^2^9 ® 

Info.nntion of a more general nature will be sought for purposes of what 
Scrlven h-jj oallod "goal-£reo*' evaluation. Questions beyond the specific 
goals and objcctivor of ^he programs will be posed to determine positive or 
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a«igatlve "gIJc effects" of the program. For cxamplo, Did the program 
eohancti thu self-conf Idencu of the candidate? Wur^ certain goals and 
competencies achieved at the expense of the desire to become a teacher? 
Infonaation reeardiOM the Backaround of the Student 

The collection of infornation concerr.inB the students' backgrounds, 
their reasons for choosing the particular teacher education program, and a 
self-assessoent of entering knowledge or behaviors will provide (1) evidence 
as to the sioilarlty or differences in population? of the students fro© the 
different teacher education programs, (2) sotoe Indication of the contribu- 
tion of entering personal qualities and skills to the achievement of 
competencies, and (3) a rough "pre-measuro" to be utilized In later assess- 
ments of growth. In future years, use of a measure of attitude towards 
self and teaching should be considered as a further source of explaining 
outcoiaes. 

Dat°> Collection and Reporting Procedures 
The information outlined above will be collected from Student Teachers^ 
Master Teachers, Supervisors, and Instructors periodically throughout the 
year by means of formal questionnaires and Interviews as well as class 
visits, informal contacts, and meetings with all of those involved in the 
programs . 

The Information collected by these means will be analyzed and sumoarleed. 
Periodic reports will be made on both an informal and a formal basis to 
those involved in the program. 

Because the purposes of the Evaluation are formative as well as suiama- 
tlve, an attempt Is being made to utilize procedures which will both 
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(1) facilitate the use of tho informtion in ongoing program inproveinQnt 
and (2) allow inJivi lunls involve J In the proj>rins to suggei^Jt areas for 
Investigation in tho subsequent sequence of lata collection anJi feedback. 
Therefore, information will be reportei informally to those Involved in 
the particular programs as a ; art of a two*way process of continuing, feed* 
back and responses between the Evaluation Unit and Program Participants • 

Formal reports will be made quarterly to the Teacher Education 
Division and to the CTPL in accordance with policies ultimately established^ 

Plans will be formulated for a follow-up of a representative sample of 
Program Graduates into their first few years of teaching--as required by 
the Ryan Act. Input into the design of the follow-up study will be 
sought from those involved in the programs. 
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